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Abstract 

This note starts from work done by Dai, Geary, and Kadanoff[T] on 
exact eigenfunctions for Toeplitz operators. It builds methods for finding 
convergent expansions for eigenvectors and eigenvalues of large-n Toeplitz 
matrices, using the infinite-n casep] as a starting point. One expansion 
is derived from operator equations having a two-dimensional continuous 
spectrum of eigenvalues, which include the eigenvalues of the finite-n ma- 
trices. Another expansion is derived from the transpose equations, which 
have no eigenvalues at all. The two expansions work together to give an 
apparently convergent expansion with an expansion parameter expressed 
as an inverse power of n. A variational principle is developed which gives 
an approximate expression for determining eigenvalues. A consistency 
condition is generated, which gives to lowest order exactly the same con- 
dition for the eigenvalue. 
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1 Introduction 
1.1 History 

This paper is a continuation of recent work by Dai, Geary, and Kadanoff[l] 
(which we shall hereafter cite as paper I) and Lee, Dai and Bettleheim [3] on 
the spectrum of eigenvalues and eigenfunctions for singular Toeplitz matrices. 
A Toeplitz matrix is one in which the marix elements, Tj,k, are functions of the 
difference between indices, T{j — k). To get sharp definitions of matrices and 
matrix elements of all orders, we define all matrix elements in terms of a single 
function, the symbol, a{z) defined for z — e"'^ on the unit circle. Thus we write 



The basic problem under consideration here is the definition of a good 
method for calculating the eigenvalues and eigenfunctions of Toeplitz matrices, 
the matrices defined by letting the indices j and k live in the interval [0, n — 1]. 
Previous authorsjHl \7\ have described the Toepltiz matrix problem by pointing 
out that the eigenvalues approach the spectrum of the analogous problem in 
which the indices vary over the set [—00,00]. This latter problem may be solved 
by Fourier transformation and has an eigenfunction ipj = e"'^^ and a corre- 
sponding eigenvalue a{e~^P). The set of all such eigenvalues, for real p, is terms 
the image of the symbol. Widom speculates [HI [7] that in the large-n Hmit, the 
discrete spectrum of the finite-n problem approaches that image, at least for 
the case in which the symbol has a singularity on the unit circle. 

Earlier authorsj^ established how this approach occurs for a very specific 
case in which the symbol had the form of singularity introduced by Fisher and 
HartwigjH [5] which is 



Note that this singularity is defined by two parameters, a, which defines a zero in 
the symbol and, /3, which defines a discontinuity. Using this symbol, the authors 
Lee, Dai, and Bettleheim[3] found the spectrum for large n and a = 0, while 
Dai, Geary and Kadanoff described a part of the spectrum for < a < —(3 < 1 
in paper L 

The latter authors considered the behavior of Toeplitz operators. These are 
Toeplitz matrices in which the indices run through the interval [0,oo]. Two 




(1) 



{z) = {2-z-l/zn-z} 
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cases should be differentiated in this analysis, when < a < 1 and the image 
of the symbol forms a closed curve.: 

case 1 . > /3 > —1. All points within the image of the symbol are eigenvalues 
of the Toeplitz operator. p] The finite-n eigenvalues sit within that curve and 
approach it as n goes to infinity. [Tj 

case II. < /3 < 1. Again, the image of the symbol forms a closed curve. 
In fact, the curve depends only upon the absolute value of /b. But now, the 
Toeplitz operator has no eigenvalues. However, the finite-n eigenvalues of the 
corresponding finite-n matrix sit within that curve and approach it as n goes to 
infinity. [Ij 

There is one more very interesting special case: a = 0. In this situation, 
if —1 < (3 < 1, the image of the symbol is a curved line segment, and the 
eigenvalues consist of all points which can be reached by connecting two points 
of that curve. Once again the eigenvalues for finite-n approach the curve while 
sitting within the region defined by the infinite-n eigenvalues. ^Sj 

1.2 The previous calculational strategy 

In the previous paper, paper I, we studied the Toeplitz eigenvalue equation 

n-l 

T{j - k)iPk = ^i^j for < j < n - 1 (3a) 

fe=0 

by studying a related Toeplitz operator equations 

oo 

TU - fc) = for < j < oo (3b) 

fc=0 

for an eigenvalue for which both equations equally had solutions. We could 
only solve the first equation numerically. We had an exact method, the Weiner 
Hopf technique, for solving the second equation. The crucial result was that the 
extension of the equation being solved to the region between j = n and j = oo 
hardly changed the solution in the region of not-too-large values of j, specifically, 
< j < approximately n/2. That is not too surprising since both equations 
have the same boundary behavior near j = and both may be expected to have 
the same asymptotic behavior for intermediate regions of j. It would not be 
surprising, then, if we extended the analysis to include an equation which was 
right near j = n — 1 and had the right asymptotics for smaller j, then we could 
get an asymptotic expansion which could work for all j. In this paper, I precisely 
propose to extend the analysis by writing a pair of asymptotic statements, each 
one correct for one of the boundary regions. 

1.3 plan of paper 

The next section includes the successive analysis based upon the two boundary 
regions. The third section puts the two analyses together to get equations 
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which will yeild an asymptotic expansion for eigenvalues and eigenfunctions. 
The previous work, paper I, had a rather heuristic method for estimating the 
size of the corrections to the eigenvalue and eigenfunction. Here we have an 
exact, testable expansion. 

2 A pair of expansions 
2.1 definitions 

In this section, we look at the Toeplitz matrix eigenvalue equation by using 
methods which work for solving the the Toeplitz operator eigenvalue equation, 
Eq. (HE]) . In both solution is generated by extending the range of the 

index variables to (—00, 00), which will then permit us to use fourier transform 
techniques. The equation for the Toeplitz matix's eigenvector can be in terms of 
three different kinds of functions which respectively are indicated by superscripts 
"0", and " + ". The first superscript indicates a function which is non-zero 
only for j < 0; the superscript "0" defines a function non-zero for < j < 
n — 1; while the third superscript describes a function non-zero in [n,oo). The 
eigenfunction we wish to calculate is "0°^ and it obeys 

00 

J2 K,,k^\ = cp-^+cj,+^ (4) 
fc— — 00 

which now holds for all integer values of j. Here, the matrix K is 

Kj,k = T{j - fc) - eSj^k (5) 

Eq. |[4]) will be analyzed in fourier transform language, with z being the 
fourier variable. Thus, the four quantities defined in that equation will be 
written as K{z),(j)~{z), ^p'^{z), and (j)'^{z), which will respectively contain powers 
of z extending from —00 to 00; only negative powers of z; non-negative powers 
extending up to and powers from z'^ to z°°. We also need to define a 

notation for the decomposition of the K operator. We write 

K{z)^K>(z)/{zK<{z)) (6) 

where has all its singularities and zeros outside the unit circle and K'^ 
has all its singularities and zeros inside the unit circle. These functions then 
respectively expand in a power series in z and in 1/z. Correspondingly, the 
fourier transforms obey 

K>{j ~ I) ^0 for j <l 

while 

K<{j - I) ^0 for I < j 

Acting to the right, K-^ {K^) respectively carry information rightward toward 
higher j values (leftward toward lower values) . 



4 



2.2 Weiner-Hopf analysis for Toeplitz operator 



This section is not at all new. It is all contained in paper I. However, the notation 
is sHghtly different here. We set n = oo and note that (j)'^ must be zero. To 
distinguish the solution for the Toeplitz operator for the one for the Toeplitz 
matrix, we write \E' for the eigenfunction and $~ for the auxiliary function (f)~ . 
We then write the fourier transform of Eq. (|3a)) as 

K>^ = zK<^- (7) 

Note that we have also dropped the superscript in our writing. 

Eq. ^ follows the usual Weiner-Hopf strategy. The left hand side of the 
equation contains only non-negative powers of z. The right hand side contains 
only non-positive powers. Then both sides can only be constant, so that Eq. 
|[7l has the solution 

if>* = C (8a) 

zK<^- = C (8b) 

with C being simply a constant in this fourier transform language. ( In coordi- 
nate space, C becomes C5{j,Q).) The solution can then be written in terms of 
two functions: 

(1/X>)(j)= j ^^"V^>(^) (9a) 
which vanishes for j < The other function is 

{IIK<){3)= j ^^z-^/K<{z) (9b) 

The analysis in paper I enables us to describe the asymptotic structure of these 
functions for large values of j in the previously analyzed case < a < — /3 < 1. 
Their fourier transforms each contain a weak singularity at z = 1 proportional 
to (1 — zY" . This zero then produces a real term which decays as In 
addition, K^{z) has a simple zero aX z = Zc = e^^" , just outside the unit circle. 
This result gives us an asymptotic form for large j 

= C{l/K>){]) - A>//+2" + Be-*P=^ (10a) 

This quantity vanishes for j > and, as we see, decays algebraically for large 
negative values of j. Paper I suggested that the two terms on the right-hand-side 
of Eq. (|10ap were both of order n~^~^" when j is of order n. This result gives 
us a small parameter A ~ n~^~^", which might be used in expansions. 
The other unknown functions can similarly be evaluated as 

= c{i/K<){] - 1) ~ A<(-jri-2" (lob) 

Here, the estimate holds when j takes on large negative values. When j is 
greater than or equal to zero, this quantity is zero. 
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2.3 Transpose of Toeplitz matrix 

There are two different forms of the equation for the ToepUtz matrix. The first 
is Eq. (|3a|) . 

The second form is a sort of transpose of Eq. (|3a| , obtained by taking that 
equation in coordinate space and replacing each coordinate, j, by j ^ j = 
n — 1 ~ j. We then get an equation in coordinate space 

n-l 
k=0 

where transposed quantities are defined as 4'f — 't'n-i-j i V'j ^ V-'"-i-j- and 
K{j — k) = K{k — j). In this way, we find the second fundamental form for the 
eigenvalue equation 

Y,K{j-k)^\ = rj + 4>+j (11) 

fc=0 

or, in Fourier transform, 

k{z)4,°{z)^^-{z) + 4>+{z) (12) 

where the Fourier transform of the new Kernel is given by 

K{z) = K{l/z)^ zk>{z)/k<{z) 
k>{z) = \/K<{\/z) 

k<{z) = llK>{l/z) (13) 
and the new wave functions are given by 

<^±(z) = (14) 

2.4 Analysis for Toeplitz matrix: right eigenvector 

Eq. ((3aj) can be analyzed using the same kinds of splitting of K employed in 
Sec. I|2.2p . We take that equation in its fourier transformed representation 

and multiply through by zK^ . One then finds 

K>^° = zK<(t)- + zK<(t>+ (15) 

The second term on the right hand side of this equation can be split up into 
parts which contain exponents of z which are respectively negative, between 
zero and n — 1 inclusive, and above n-l in the form 

zK<(l)+ = {zK<(j)+)- + {zK<(l>+f + {zK<(l)+)+ 
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Then this equation can be rearranged into a form in which terms in non-positive 
powers of z appear on one side and non-negative powers on the other, i.e. 

K>il? - {zK<(l)+f - {zK<(j}+)+ = zK<(j)- + {zK<(j)+)- = C (16) 

The second equal sign in this equation sets both sides equal to a constant, as in 
Eq. {HI). 

We solve for ijP , finding 

^0 = {l/K>)C + {l/K>)[{zK<c^+f + {zK<c^+)+] 

since {\/K^), acting to the right pushes coordinate indices toward higher values, 

V-" - [{l/K>)Cf + [{l/K>){zK<4>+)y (17a) 

The equation for the negative j domain in Eq. lfT6|) may be solved for 4>~ to 
give 

cp- = {zK<)-\C -{zK< (})+)-] (17b) 

In contrast to the case of the Toeplitz operator, the equation for the eigenfunc- 
tion is given in terms of the subsidiary functions cf)'^ . Further for the Toeplitz 
operator only the function is needed to determine the eigenfunction. Here 
both and if^ are involved. These are important distinctions. 

Note the 1/z to the right of the equal sign in Eq. (|17b|) . This factor has the 
effect of making the leading term in the expansion of V'~ be l/z, which is then 
followed by highter powers of 1/ z. This is precisely the right structure for the 
expansion of (/)^ . 

Eq. lfT7|) gives us expressions for two of the quantities we need to know. How- 
ever, we are far from done. These equations give us relatively simple expressions 
for ijp and 4'~ , but we do not yet have an equivalently simple expression for 
In both of the two subequations in Eq. lfT7|) . we can evaluate the first 
term directly while second term could be evaluated by quadratures if we but 
knew (j)^ . Note that the lowest-order terms in both of these subequations are 
precisely the same as in the solution to the Toeplitz operator. 

Our previous results [I], show that for small and intermediate values of j in 
the set [0, n — 1], the first term in Eq. I|17ap varies over a wide range, being of 
order C for small values of j and of order CA, with 

A = l/n2"+i ~ |e-'P<="| (18) 

for j of order n. Similarly the first term in Eq. l|17bp varies from being of 
order C for —j or order unity to being of order CA for —j of order n. From the 
previous analysis one might guess that 0+ might be of the same order as the 
Weiner-Hopf values of ^j/C, for j of order n, which is of order A. Thus, the 
correction terms in Eq. I|17ap seems to be, at most, of this relative order while 
the correction term in Eq. l|17bp appears to be of relative order A^. So far, we 
have no expressions of corresponding simplicity for (j)'^ itself. 
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2.5 Analysis for Toeplitz matrix: left eigenvector 

It appears that we have usable lowest order results for two of the three unknown 
functions. The third unknown, 0"'", contributes correction terms but it is hard 
to see a direct way to get it from Eq. (fT6| . We do have Eq. (fT2l) in reserve from 
which we can get additional information. This equation has the consequence, 

k>^^ ^ z-^k<4)+ + z-^k<^~ (19) 

We then split up the term z'^K'^cj)^ into the different regions, — , 0, and + to 
derive a result analogous to Eq. lfT6|) . namely 

i^>^o _ (2-ii^<0+)O _ {^z~^k<^+)+ = z-^k<4>- + {z-'^k<4>+)- (20) 

There is, however, a substantial differences between Eq. lfT6|) and Eq. (|20|) . 
The former has a z in it, while the latter has a z~^. As a result, the first term 
to the right of the equal sign in Eq. l(20|) cannot have a constant term in it. 
It begins its expansion at (1/z)^ and continues to higher powers of 1/z. The 
second term to the right of the equal sign also cannot have a constant term in 
it since (.)~ is defined to start with a 1/z term. Therefore the two sides of the 
equal sign cannot be equal to a non-zero constant. They must both be zero. 
This is, at bottom, a refiection of the fact that the transposed Weiner-Hopf 
operator equation has no eigenvalue solutions. 

We thus see that Eq. l(20|) has the double consequence that 

k>^pO _ (2-ii^<0+)O _ [z-^k<4>+)+ = (21a) 

and 

z~'^k<^- + {z-^k<4,+)- = (21b) 

We now write the transposed analogs of Eq. (|17ap and Eq. (|17bp , these analogs 
are 

= [{l/k>)iz-^k<^+)y (22a) 

and 

4>- ^ -{z/k<){z-^k<^+)- (22b) 

These equations are simpler than Eq. (|17ap and Eq. (|17bp because the terms 
in C are lacking. When the transposed quantities are replaced by their values 
in untransposed quantities, these equations read 

V'" = [K<{{z-'lK>)^-)y (23a) 

and 

0+ = -zK>[{z-^/K> )(!)-]+ (23b) 

Eq. I|23ap is another expression for the eigenfunction, analogous to Eq. I|17ap . 
We hope that the two equations are equivalent. Eq. l|23bp gives us a usable 
expression for 0"'", which can then be employed to give explicit values to the 
correction terms in Eq. (|17ap and Eq. (|17bp . These four equations will give us 
the results we need for the various eigenfunctions. 
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3 Results 



3.1 Equations for eigenfunctions 

We argue about the relative sizes of the various terms in the equations by saying 
that and l/K"^ serve as propagators which connect the regions described 

by the symbols — , 0, and +. Any connection between — and + is necessarily 
small, as is any connection of C to +. I assert that these connections are of 
order A. This smallness makes terms involving several regions necessarily small 
and makes it possible for our expansions for eigenfunctions, given below, to be 
rapidly convergent. 

One such equation is derived by substituting the expression for in Eq. 
I|23bp which gives 

(l>+ = -zK>[{zK>K<)-^C]+ + zK>{{zK>)-^)[{zK-^)-^(t>+)]-}+ (24) 

The argument which we have just gave makes the first term of order A and the 
second of order A'^, and suggests that this expansions is likely to converge. An 
analogous derivation gives us an equation for (j)" . Start from Eq. l|17bp and 
substitute into that Eq. l|23b|) for 0'^, giving 

(j)- = {zK<)-^{C + {z'K<K>[{zK>)-^(^-]+)-} (25) 

For i at or near —1 the first term in the curly brackets is of order A" while the 
second is of order A^ . 

Using the same method, we can find an equation for the eigenfunction 

V;" = [{l/K>)Cf + [{l/K>){zK<(l>+)y (26) 

3.2 Eigenvalue condition: an extremal 

It appears that we have a potentially convergent expansion for our eigenfunction. 
However, there is a potential difficulty. The expansions cannot always converge. 
The equation for the various functions determine an eigenvalue, and cannot 
possibly converge unless the eigenvalue condition is met. 

One conventional way of finding eigenvalues is through the use of an ex- 
tremum. 

Consider the quantity: 

Q[x] = N/D with 

1=0 

n-l 

^ = = E [^(J' - ^) - '^J-'^] Xk^ix-T-x] (27) 

j,k=0 

This quantity is zero when e is an eigenvalue of the n-th order Toeplitz matrix 
and X is the corresponding eigenfunction. If x deviates from this eigenfunction 
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by a small amount, then Q is of order of the square of the deviation. Since 
the eigenvalues vary by an amount of order unity, we might expect that for an 
arbitrarily chosen smoothly varying x, Q would be of order unity. Of course, if 
e is not an eigenvalue of the Toeplitz matrix, this extremal property is lost. 

Now look at the special case in which x is our lowest order approximation 
for the eigenfunction as given by the first term in Eq. (|17ap . 

- = {llK>){j) for < J < n - 1 (28) 

(For simplicity, we have set C = 1.) With this choice the denominator has the 
value 

ji-i 

D = Y,{l/K>m (l/K>){n -I -I) (29a) 
/=o 

The first step in simplifying the numerator is to replace the sum over k = 
[0, n — 1] by a sum over k = [0, oo] minus a sum over k = [n, oo]. The sum over 
[0, oo] vanishes so that 

n— 1 oo 
k—n 

The j-sum is split into pieces. We sum over j = [0, oo] and subtract the piece 
j = [n, oo]. Eq. ^ then gives a result in which N comes out as the sum of two 
terms, N = A^++ + N^^ which respectively have the values: 

oo oo 

N++^ E '^j+n-^k+nKi-j-k-l-n)= (l/X>)(j+n)] (l/if>)(fc+n)X(-j-fc-l-n) 

j,k=0 j,k=0 

(29b) 

and 

oo oo 

N+- = -J2 = - E(V^>)(^ + ") i^/K<){-k - 1) (29c) 

fc=0 k=0 

The results of paper I enable us to estimate the order of magnitude of the 
various terms in Eq. l(29l) . The denominator of Eq. I|29ap , has the magnitude 
D = 0{nX), unless there is a cancellation in the sum. The numerator term 
N~^~^ has the order of magnitude N'^^ = 0{nX^) since each K in the product is 
of order nX and the sum converges by falling off algebraically. The numerator 
term iV"' has the order of magnitude = 0{X) since K'^faWs off quite 

rapidly from its values, of order 1, for small values of k. This estimate gives 
the maximum possible result. The value of this term may be much smaller, 
and even zero, if there is cancellation between the exponential and the algebraic 
terms in {l/K-'){k + n) for small values of k. Indeed, I am expecting such a 
cancellation to occur precisely in the situation in which e has been chosen to be 
an eigenvalue of the Toeplitz matrix. In sum, our extremal, contains two terms. 
One term, N~^~ /D, of order 1/n, if there is no cancellation in Eq. (|29cp and 
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the other of order A^. The latter is smaller, unless the, expected, cancellation 
occurs. 

Why should one expect the cancellation in Eq. I|29cp ? The variational 
quantity, Q will approach zero quadratically as x approaches the correct eigen- 
function In paper I, it was shown that the normalized functions generated 
by the Toplitz operator differed from the ones for the Toeplitz matrix, in the 
case in which the eigenvalues are identical, by an amount of order \f\fn. Thus, 
our extremal should be o{\/n) if e is an eigenvalue of the Toeplitz matrix. The 
fact that we need the cancellation in Eq. I|29cp to achieve the correct order of 
magnitude strongly suggests that the vanishing of iV^ is an eigenvalue condi- 
tion. 

3.3 An apparently exact condition 

So far, our heuristics have suggested that an appropriate approximate eigenvalue 
condition is the vanishing of the quantity TV'' in Eq. (|29cp . Can we find a 
more exact eigenvalue condition? Where should we look? 

In the Toeplitz-operator case, the explicit factor of z in the expression, Eq. 
|[6l), for the kernel gives that kernel an eigenfunction with zero eigenvalue. Con- 
versely the factor z"^ in the transposed kernel gives it no eigenvalues at all. 
Consequently we should look to the most explicit appearance of in a trans- 
posed equation to look for the possible failure of the existence of an eigenvalue. 
Eq. l(2T|) are the transposed equations for the eigenfunction and subsidiary func- 
tion. The first place to look is in Eq. l|21bp . which has the suggestive property 
that it contains an explicit factor of . 

Both sides of the equation are zero. The left hand side is an expansion in 
1/z starting at 1/z and proceeding to higher order in 1/z. At each order, the 
two terms on the left hand side of Eq. l|21bp must cancel. Specifically, because 
of the in the first term, that term starts off with a possible non-zero term of 
order The same must be true for the other term on the left of Eq. (|21bp . 
Therefore, we must satisfy the condition 

(z-ii^<^+)_i = 

that the constant (^-independent) term in must be zero. As a conse- 

quence, in Eq. l|23bp . the z" or j = n term in the square bracket must be zero. 
In coordinate space: 

— oo 

Y,{l/K>){n-k^l)rk^Q (30) 

This equation will determine the eigenvalues of the Toeplitz matrices.lt is pleas- 
ing to notice that this equation is essentially the same as the result in the more 
approximate Eq. I|29cp . The only difference is that the exact auxilary quantity, 
4>~ has replaced its approximation from the Toeplitz operator, $~. 
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To see the consequences of this eigenvector equation plug in the lowest order 
evaluation of 0^7 from Eq. (|10b| to get 



This is our lowest order (in A) expression for an eigenvalue condition. 

4 Looking forward 

We have now completed our task of constructing an analytic (albeit heuristic) 
structure for an eigenfunction expansion. The work is plausible but not proven. 
The next step might be to construct proofs of the convergence of these results or 
alternatively to back them up with good numerical work. I have not yet carried 
out these tasks. 

The work, in fact, lacks two checks which one might hope to out into place 
using purely analytic means. I have not checked that the analytics yields the 
Fisher and Hartwig[4l[3 results for the product of eigenvalues. If fact, I cannot 
see from where they might arise. I also have not checked that the direct and 
the transpose methods give exactly the same eigenfunction. 

Last, but certainly not least, I don't know how the eigenfunctions and eigen- 
values at the ends of the spectrum might arise. Numerical evidence shows that 
they are different from the results at the middle of the spectrum, but the dif- 
ference has been left unexplored up to now. 

In some respects, it is very pleasing to see that there is yet room for good 
additional work on this problem. 




(31) 



k=-l 
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